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DETAILED ACTION 

1 . This document is the first Office Action on the merits. This action is responsive 
to the following communications: The Non-Provisional Application, which was filed on 
December 11, 2003, and an Information Disclosure Statement (IDS), which was also 
filed on December 11, 2003. 

2. Claims 1-24 have been examined, with claims 1, 9, and 17 being the 
independent claims. 

3. The Drawings are objected to. 

4. Claims 1-24 are rejected. 

Information Disclosure Statement 

5. An initialed and dated copy of applicant's IDS form 1449, which was filed on 
December 1 1 , 2003, is attached to this Office Action. 

Drawings 

6. The drawings are objected to because the drawings elements are not clearly 
differentiated in that two drawing elements have the same names, both elements 318 
and 322 are identified as "structural element identifier." Corrected drawing sheets in 
compliance with 37 CFR 1 .121(d) are required in reply to the Office action to avoid 
abandonment of the application. Any amended replacement drawing sheet should 
include all of the figures appearing on the immediate prior version of the sheet, even if 
only one figure is being amended. The figure or figure number of an amended drawing 
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should not be labeled as "amended." If a drawing figure is to be canceled, the 
appropriate figure must be removed from the replacement sheet, and where necessary, 
the remaining figures must be renumbered and appropriate changes made to the brief 
description of the several views of the drawings for consistency. Additional replacement 
sheets may be necessary to show the renumbering of the remaining figures. Each 
drawing sheet submitted after the filing date of an application must be labeled in the top 
margin as either "Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1.121(d). If 
the changes are not accepted by the examiner, the applicant will be notified and 
informed of any required corrective action in the next Office action. The objection to the 
drawings will not be held in abeyance. 

Claims Rejections - 35 U.S.C. 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

7. Claims 1-7, 9-15, and 17-23 are rejected under 35 U.S.C. 102(b) as being clearly 
anticipated by Raman (U.S. Patent 5,748,186), issued May 5, 1998 [hereinafter 
"Raman"]. 

Regarding dependent claim 1, Raman teaches: 
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A method for creating a presentation document, the method comprising: 
creating, in dependence upon an original document, a structured 
document comprising one or more structural elements; and 
(See, Raman, col. 2, lines 18-35. See also, Raman, col. 3, lines 6-11, teaching 
retrieving a document and converting the information to a "common intermediate 
representation" with a structure of the information.) 

creating a presentation grammar for the structured document, wherein the 
presentation grammar for the structured document includes grammar elements 
each of which includes a structural element identifier for at least one structural 
element of the structured document. 
(See, Raman, col. 6, lines 29-31, teaching that control signals can include recognized 
speech, which inherently includes a grammar to be recognized. Further, see, Raman, 
claims 14 and 22, teaching interactivity of the system accomplished using only speech.) 

Regarding dependent claim 2, Raman teaches: 

The method of claim 1 wherein creating a structured document further 

comprises inserting in the structured document structural element identifiers for 

the structural elements. 
(See, Raman, Col. 5, lines 21-32, teaching changing structural element identifiers, 
rendering methods, to accommodate different renderings. The various changed 
identifiers amounting to differing styles for the structured document.) 
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Regarding dependent claim 3, Raman teaches: 

The method of claim 1 wherein creating a structured document further 
comprises converting existing structural element identifiers from the original 
document to structural element identifiers for the structural elements of the 
structured document. 
(See, Raman, col. 2, lines 18-34, and col. 3, line 6 through col. 4, line 76, teaching 
receiving original documents, e.g.: rendered in HTML, which is a structured document 
language, and parsing the data to a structured hierarchical attributed tree.) 

Regarding dependent claim 4, Raman teaches: 

The method of claim 1 wherein creating a presentation grammar for the 
structured document comprises: 

identifying the content type of the original document; 
(See, Raman, col. 5, lines 47-56, teaching retrieval, recognition, and presentation of an 
HTML document, as an example of the invention. See also, Raman, col. 3, lines 6-8, 
teaching a "recognizer 130" coupled to the receiver 120, to convert information 11 into a 
common intermediate high-level logical data structure 200, the recognizer must 
inherently identify and know the content type of the original document in order to 
process it.) 

selecting, in dependence upon the content type, a full presentation 
grammar from among a multiplicity of full presentation grammars; and 
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(See, Raman, col. 3, lines 8-20, teaching, for example, presentation of aural information 
by a speech synthesizer, monitor, Braille and by animated cartoon. See also, Raman, 
col. 3, lines 30-34, teaching the use of a voice input speech recognizer to control the 
presenter of the content types.) 

filtering the full presentation grammar into a presentation grammar for the 

structured document in dependence upon the structural elements of the 

structured document. 
(It is noted that filtering the full presentation grammar includes writing from the full 
presentation grammar to the presentation grammar for the structured document each 
grammar element having a structural element identifier of a structural element that 
occurs in the structured document. Applicants' disclosure, page 3 lines 23-26. 

See, Raman, col. 2, lines 36-45, teaching the use of "control signals" as 
"presentation grammar" to control the modality being used to control the presentation. 
See, Raman, col. 6, lines 30-33, teaching that a control signal may include recognized 
speech as an input. See, also Raman, col. 3, lines 30-34, teaching that the data 
retriever and the presentor of the system may be controlled by voice recognized input 
couple to a speech recognizer. And see, Raman, col. 5, lines 38-46, teaching 
"navigational methods associated with objects allow the user to browse through the text 
by taking into consideration the underlying structure of the document." And see, 
Raman, claim 1, lines 13-15, teaching "presenting the common intermediate 
representation using a plurality of user communication modalities according to the 
hierarchical attribute trees." And see, Raman, col. 4, lines 22-27, teaching speech 
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response to aural presentation of stock data. For each type of speech response, it is 
inherent that there be an associated grammar.) 

Regarding dependent claim 5, Raman teaches: 

The method of claim 4 wherein identifying the content type comprises 
identifying the content type in dependence upon a filename extension. 
(See, Raman, col. 3, lines 41-44, teaching recognizing file type by extension, i.e.: "html." 
See also, Raman, col. 5, lines 47 through col. 6, line 4, teaching identification of the 
document by tags, such as <html>.) 

Regarding dependent claim 6, Raman teaches: 

The method of claim 4 wherein identifying the content type comprises 
identifying the content type in dependence upon document header elements. 
(See, Raman, col. 4, lines 38-49, teaching receiving a source document by characters 
encoded as text as well as marks placed in the text to define the structure, and the 
"recognizer" to parse the character stream into fundamental source elements, for 
example, title, sections, sub-sections, paragraphs, sentences, links, forms and so forth. 
See also, Raman, col. 5, lines 47 through col. 6, line 4, teaching identification of the 
document by text element tags, such as <head>, <title>, <body> and <P>.) 
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Regarding dependent claim 7, Raman teaches: 

The method of claim 4 wherein filtering the full presentation grammar 
comprises writing from the full presentation grammar to the presentation 
grammar for the structured document each grammar element having a structural 
element identifier of a structural element that occurs in the structured document. 
(See, Raman, col. 2, lines 36-45, teaching the use of "control signals" as "presentation 
grammar" to control the modality being used to control the presentation. See, Raman, 
col. 6, lines 30-33, teaching that a control signal may include recognized speech as an 
input. See, also Raman, col. 3, lines 30-34, teaching that the data retriever and the 
presentor of the system may be controlled by voice recognized input couple to a speech 
recognizer. And see, Raman, col. 5, lines 38-46, teaching "navigational methods 
associated with objects allow the user to browse through the text by taking into 
consideration the underlying structure of the document." And see, Raman, claim 1, 
lines 13-15, teaching "presenting the common intermediate representation using a 
plurality of user communication modalities according to the hierarchical attribute trees." 
And see, Raman, col. 4, lines 22-27, teaching speech response to aural presentation of 
stock data. For each type of speech response, it is inherent that there be an associated 
grammar.) 

Regarding claims 9-15, claims 9-15 incorporate substantially similar subject matter as 
claimed in claims 1-8, respectively, and are rejected along the same rationale. 



Application/Control Number: 10/734,764 



Art Unit: 2176 



Page 9 



Regarding claims 17-23, claims 17-23 incorporate substantially similar subject matter 
as claimed in claims 1-8, respectively, and are rejected along the same rationale. 

8. It is noted that any citations to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be considered to 
be limiting in any way. A reference is relevant for all it contains and may be relied upon 
for all that it would have reasonably suggested to one having ordinary skill in the art. 
See, MPEP2123. 

Claims Rejection - 35 U.S.C. 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

9. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raman 
as applied to claim 1 above, and further in view of Josephson, (U.S. Patent Publication 
2003/023435 A1), published January 30, 2003 [hereinafter "Josephson"]. 
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Regarding dependent claim 8, Raman in view of Josephson teaches: 

The method of claim 4 wherein the full grammar comprises a multiplicity of 
grammar elements for the content type, wherein each grammar element 
includes: 

an identifier of a structural element; 
a key phrase for invoking a. presentation action; and 
a presentation action identifier representing a presentation action. 
(The key phrase function is inherent in Raman, but not expressly taught. See, Raman, 
col. 6, lines 30-33, teaching that a control signal may include recognized speech as an 
input. See, also Raman, col. 3, lines 30-34, teaching that the data retriever and the 
presenter of the system may be controlled by voice recognized input couple to a speech 
recognizer. And see, Raman, col. 4, lines 22-27, teaching speech response to aural 
presentation of stock data. For each type of speech response, it is inherent that there 
be an associated grammar and for each grammar that there be an identifier of the 
object to be acted upon, a signal for the action, and a presentation of the action 
signaled. In corporation of the grammar elements in a central file or in a separate file 
for each media type is a design decision between art recognized equivalents, namely 
placing controls in one or several files. In general, Raman teaches the creation of a 
structured document for user interaction based on attributes and classification, but it 
does not expressly teach a key phrase. 
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Josephson expressly teaches the use of a key phrase for invoking a presentation 
action. See, Josephson, paragraphs [0191]-[0259]. 

It would have been obvious to one of ordinary skill in the art at he time of the 
invention to combine the teachings of Raman and Josephson to result in a user 
interactive control of a structured document using a list of attributes, classifications 
(tags), and associated scope. 

Both Raman and Josephson are related to the art of user interactions with 
computers to control document production, including via voice recognition commands, 
and both use tag, or classification, structured documents. 
The suggestion or motivation for combining the references is found in Josephson, 
discussing the invention as an improvement to "voice-mousing" and control of "select 
next" type commands, which is one type of navigational control discussed in Raman. 
See, Josephson, paragraphs [0008]-[0010], and see, Raman, col. 7, lines 5-50.) 

Regarding claims 16 and 24, claims 16 and 24, incorporate substantially similar subject 
matter as claimed in claim 8, and are rejected along the same rationale. 

10. It is noted that any citations to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be considered to 
be limiting in any way. A reference is relevant for all it contains and may be relied upon 
for all that it would have reasonably suggested to one having ordinary skill in the art. 
See, MPEP2123. 
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Conclusion 

1 1 . The following prior art is made of record and not relied upon that is considered 
pertinent to applicants' disclosure: 

Ladd, et al. (U.S. Patent 6,269,336 B1), teaching interactive markup language for 
interactive dialog between a person and a computer. 

Dantzig, et al. (U.S. Patent Application Publication 2003/0071833 A1), teaching 
using speech for input and output events with multi-modal applications, including Voice 
XML documents and browsers. 

Guerrra, etal. (U.S. Patent Application Publication 2002/0188451 A1), teaching a 
dynamically configured speech recognition portal. 

Ehsani, et al. (U.S. Patent Application Publication 2002/0032564 A1), teaching 
creation of phrase based grammar networks to control human-machine interaction. 

Huang (U.S. Patent Application Publication 2001/0032218 A1), teaching use of 
identifiers in the conversion of unstructured to structured documents. 

W3C, "XHTML+Voice Profile 1.0," December 21, 2001, pages 1-20, teaching 
markup language based visual and spoken Web based interactions. 

W3C, "Speech Synthesis Markup Language Version 1.," December 2, 2002, 
downloaded pages 1-36, teaching voice activated browser for Web access through 
spoken interaction. 

IBM, "IBM WebSphere Voice Server 2.0 Implementation Guide," IBM Redbook, 
May 2002, title page, copyright page, and pages 251-276 and 291-292. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael K. Botts whose telephone number is 571-272- 
5533. The examiner can normally be reached on Monday Thru Friday 8:00-4:00 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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